Should You Be Using Accelerated Mobile Pages (AMPs)?

What, exactly, are the advantages to offering Accelerated Mobile Pages (AMPs)? And do you really need to be using them?